Constructing Cooking Ontology for Live Streams

We build a cooking domain knowledge by using an ontology schema that reflects natural language processing and enhances ontology instances with semantic query. Our research helps audiences to better understand live streaming, especially when they just switch to a show. The practical contribution of our research is to use cooking ontology, so we may map clips of cooking live stream video and instructions of recipes. The architecture of our study presents three sections: ontology construction, ontology enhancement, and mapping cooking video to cooking ontology. Also, our preliminary evaluations consist of three hierarchies—nodes, ordered-pairs, and 3-tuples—that we use to referee (1) ontology enhancement performance for our first experiment evaluation and (2) the accuracy ratio of mapping between video clips and cooking ontology for our second experiment evaluation. Our results indicate that ontology enhancement is effective and heightens accuracy ratios on matching pairs with cooking ontology and video clips

Spiking Inception Module for Multi-layer Unsupervised Spiking Neural Networks

Spiking Neural Network (SNN), as a brain-inspired approach, is attracting attention due to its potential to produce ultra-high-energy-efficient hardware. Competitive learning based on Spike-Timing-Dependent Plasticity (STDP) is a popular method to train an unsupervised SNN. However, previous unsupervised SNNs trained through this method are limited to a shallow network with only one learnable layer and cannot achieve satisfactory results when compared with multi-layer SNNs. In this paper, we eased this limitation by: 1)We proposed a Spiking Inception (Sp-Inception) module, inspired by the Inception module in the Artificial Neural Network (ANN) literature. This module is trained through STDP-based competitive learning and outperforms the baseline modules on learning capability, learning efficiency, and robustness. 2)We proposed a Pooling-Reshape-Activate (PRA) layer to make the Sp-Inception module stackable. 3)We stacked multiple Sp-Inception modules to construct multi-layer SNNs. Our algorithm outperforms the baseline algorithms on the hand-written digit classification task, and reaches state-of-the-art results on the MNIST dataset among the existing unsupervised SNNs.Comment: Published at the 2020 International Joint Conference on Neural Networks (IJCNN); Extended from arXiv:2001.0168

Enhancing Space-time Video Super-resolution via Spatial-temporal Feature Interaction

The target of space-time video super-resolution (STVSR) is to increase both the frame rate (also referred to as the temporal resolution) and the spatial resolution of a given video. Recent approaches solve STVSR with end-to-end deep neural networks. A popular solution is to first increase the frame rate of the video; then perform feature refinement among different frame features; and last increase the spatial resolutions of these features. The temporal correlation among features of different frames is carefully exploited in this process. The spatial correlation among features of different (spatial) resolutions, despite being also very important, is however not emphasized. In this paper, we propose a spatial-temporal feature interaction network to enhance STVSR by exploiting both spatial and temporal correlations among features of different frames and spatial resolutions. Specifically, the spatial-temporal frame interpolation module is introduced to interpolate low- and high-resolution intermediate frame features simultaneously and interactively. The spatial-temporal local and global refinement modules are respectively deployed afterwards to exploit the spatial-temporal correlation among different features for their refinement. Finally, a novel motion consistency loss is employed to enhance the motion continuity among reconstructed frames. We conduct experiments on three standard benchmarks, Vid4, Vimeo-90K and Adobe240, and the results demonstrate that our method improves the state of the art methods by a considerable margin. Our codes will be available at https://github.com/yuezijie/STINet-Space-time-Video-Super-resolution

Volatility forecast based on intelligent EGARCH error correction model

Kako je promjenjivost dionica na tržištu vrlo nelinearano povezana i vremenski kolebljiva, teško ju je predvidjeti pomoću tradicionalnih metoda predviđanja. Objašnjavajući postojeće probleme trenutnih metoda predviđanja promjenjivosti, koristimo model zasnovan na metodi najmanjih kvadrata s težinama potpore vektorskoj regresiji (WLS-SVR) za predviđanje promjenjivosti indeksa dionica u ovom radu. Nakon predviđanja, postoji niz pogrešaka koji je slučajna vremenska serija. Stoga, ovaj članak predlaže uporabu EGRACH modela za stvaranje modela predviđanja grešaka zasnovanog na dobiti predviđenoj vremenskim nizom pogrešaka. Nakon toga, koristimo dobivene rezultate za ispravljanje nestabilnosti dionica. Konačno, koristimo nestabilnost Šangajskog složenog indeksa kao objekta primjene. Eksperimentalni rezultati pokazuju da je točnost predviđanja ove metode znatno poboljšana u odnosu na druge metode predviđanja.As the stock market volatility is highly nonlinear, coupling and time varying, it is difficult to predict by the traditional forecasting methods. For explaining the existing problems of the current volatility forecasting method, we use the model based on the weighted least squares support vector regression (WLS-SVR) method to predict the stock index volatility in this paper. After the prediction, there is the error sequence that is a random time series. Therefore, this paper proposes the use of EGRACH model to construct an error forecast model based on the returns of stock predicted error time series. Then, we use these results to correct the volatility of stock. Finally, we use the volatility of Shanghai Composite Index as the application object. The experimental results show that the prediction accuracy of this method has improved significantly with regard to other forecasting methods

The Role of Edge Robotics As-a-Service in Monitoring COVID-19 Infection

Deep learning technology has been widely used in edge computing. However, pandemics like covid-19 require deep learning capabilities at mobile devices (detect respiratory rate using mobile robotics or conduct CT scan using a mobile scanner), which are severely constrained by the limited storage and computation resources at the device level. To solve this problem, we propose a three-tier architecture, including robot layers, edge layers, and cloud layers. We adopt this architecture to design a non-contact respiratory monitoring system to break down respiratory rate calculation tasks. Experimental results of respiratory rate monitoring show that the proposed approach in this paper significantly outperforms other approaches. It is supported by computation time costs with 2.26 ms per frame, 27.48 ms per frame, 0.78 seconds for convolution operation, similarity calculation, processing one-minute length respiratory signals, respectively. And the computation time costs of our three-tier architecture are less than that of edge+cloud architecture and cloud architecture. Moreover, we use our three-tire architecture for CT image diagnosis task decomposition. The evaluation of a CT image dataset of COVID-19 proves that our three-tire architecture is useful for resolving tasks on deep learning networks by edge equipment. There are broad application scenarios in smart hospitals in the future

TLS-bridged co-prediction of tree-level multifarious stem structure variables from worldview-2 panchromatic imagery: a case study of the boreal forest

In forest ecosystem studies, tree stem structure variables (SSVs) proved to be an essential kind of parameters, and now simultaneously deriving SSVs of as many kinds as possible at large scales is preferred for enhancing the frontier studies on marcoecosystem ecology and global carbon cycle. For this newly emerging task, satellite imagery such as WorldView-2 panchromatic images (WPIs) is used as a potential solution for co-prediction of tree-level multifarious SSVs, with static terrestrial laser scanning (TLS) assumed as a ‘bridge’. The specific operation is to pursue the allometric relationships between TLS-derived SSVs and WPI-derived feature parameters, and regression analyses with one or multiple explanatory variables are applied to deduce the prediction models (termed as Model1s and Model2s). In the case of Picea abies, Pinus sylvestris, Populus tremul and Quercus robur in a boreal forest, tests showed that Model1s and Model2s for different tree species can be derived (e.g. the maximum R2 = 0.574 for Q. robur). Overall, this study basically validated the algorithm proposed for co-prediction of multifarious SSVs, and the contribution is equivalent to developing a viable solution for SSV-estimation upscaling, which is useful for large-scale investigations of forest understory, macroecosystem ecology, global vegetation dynamics and global carbon cycle.This work was financially supported in part by the National Natural Science Foundation of China [grant numbers 41471281 and 31670718] and in part by the SRF for ROCS, SEM, China. (41471281 - National Natural Science Foundation of China; 31670718 - National Natural Science Foundation of China; SRF for ROCS, SEM, China)http://www-tandfonline-com.ezproxy.bu.edu/doi/abs/10.1080/17538947.2016.1247473?journalCode=tjde20Published versio

Comparison and Weighted Summation Type of Fuzzy Cluster Validity Indices

Finding the optimal cluster number and validating the partition resultsof a data set are difficult tasks since clustering is an unsupervised learning process.Cluster validity index (CVI) is a kind of criterion function for evaluating the clusteringresults and determining the optimal number of clusters. In this paper, we present anextensive comparison of ten well-known CVIs for fuzzy clustering. Then we extendtraditional single CVIs by introducing the weighted method and propose a weightedsummation type of CVI (WSCVI). Experiments on nine synthetic data sets and fourreal-world UCI data sets demonstrate that no one CVI performs better on all datasets than others. Nevertheless, the proposed WSCVI is more effective by properlysetting the weights

Identification and Characterization of microRNAs from Peanut (Arachis hypogaea L.) by High-Throughput Sequencing

BACKGROUND: MicroRNAs (miRNAs) are noncoding RNAs of approximately 21 nt that regulate gene expression in plants post-transcriptionally by endonucleolytic cleavage or translational inhibition. miRNAs play essential roles in numerous developmental and physiological processes and many of them are conserved across species. Extensive studies of miRNAs have been done in a few model plants; however, less is known about the diversity of these regulatory RNAs in peanut (Arachis hypogaea L.), one of the most important oilseed crops cultivated worldwide. RESULTS: A library of small RNA from peanut was constructed for deep sequencing. In addition to 126 known miRNAs from 33 families, 25 novel peanut miRNAs were identified. The miRNA* sequences of four novel miRNAs were discovered, providing additional evidence for the existence of miRNAs. Twenty of the novel miRNAs were considered to be species-specific because no homolog has been found for other plant species. qRT-PCR was used to analyze the expression of seven miRNAs in different tissues and in seed at different developmental stages and some showed tissue- and/or growth stage-specific expression. Furthermore, potential targets of these putative miRNAs were predicted on the basis of the sequence homology search. CONCLUSIONS: We have identified large numbers of miRNAs and their related target genes through deep sequencing of a small RNA library. This study of the identification and characterization of miRNAs in peanut can initiate further study on peanut miRNA regulation mechanisms, and help toward a greater understanding of the important roles of miRNAs in peanut

Structural engineering of pyrrolo[3,4-: F] benzotriazole-5,7(2 H,6 H)-dione-based polymers for non-fullerene organic solar cells with an efficiency over 12%

In this work, we have synthesized two wide band gap donor polymers based on benzo[1,2-b:4,5-b′]dithiophene (BDT) and pyrrolo[3,4-f]benzotriazole-5,7(2H,6H)-dione (TzBI), namely, PBDT-TzBI and PBDT-F-TzBI and studied their photovoltaic properties by blending them with ITIC as an acceptor. Polymer solar cell devices made from PBDT-TzBI:ITIC and PBDT-F-TzBI:ITIC exhibited power conversion efficiencies (PCEs) of 9.22% and 11.02% and while annealing at 160 \ub0C, improved the device performances to 10.24% and 11.98%, respectively. Upon solvent annealing with diphenyl ether (DPE) (0.5%) and chlorobenzene (CB), the PCE of the PBDT-F-TzBI-based device increased to 12.12%. The introduction of the fluorinated benzodithiophene (BDT-F) moiety on the backbone of PBDT-F-TzBI improved the open circuit voltage, short circuit current and fill factor simultaneously. The high PCEs of the PBDT-F-TzBI:ITIC-based devices were supported by comparison and analysis of the optical and electronic properties, the charge carrier mobilities, exciton dissociation probabilities, and charge recombination behaviors of the devices